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VARIATIONAL ANALYSIS AND REGULARITY OF THE MINIMUM TIME 
FUNCTION FOR DIFFERENTIAL INCLUSIONS 


LUONG V. NGUYEN 

Abstract. We study the time optimal control problem for differential inclusions with a general 
closed target. We first give the representation of the proximal horizontal subgradients of the mini¬ 
mum time function T and then, together with the representation of the proximal subgradients, we 
obtain some relationships between the normal cones to the sublevel of T and the normal cones to 
its epigraph. The relationships allow us to get the propagation of the proximal subdifferential as 
well as of the proximal horizontal subdifferential of T along optimal trajectories. Finally, we show, 
under suitable assumptions, that the epigraph of T is i/j-convex near the target. This is the first 
nonlinear ^-convexity result valid in any dimension. 


1. Intoduction 


Let F : M n zzj M” be a Lipschitz continuous sublinear multifunction and 1C be a closed subset of 
P. We consider the minimum time function associated to the target /C for the differential inclusion 


x(s) G F{x(t)), a.e. t > 0 
x(0) = xq G M n 


A trajectory of F starting from xq is an absolutely continuous function x(-) defined on [0, +oo) 
satisfying (EH), i-e., x(t) G F(x(t)) for a.e. t > 0 and x(0) = xo- Here, the notion x{t) refers to the 
derivative of x(-) at the time t and it is the right derivative if t = 0. 

The minimum time function for the differential inclusion m associated to the target 1C is 
defined as follows: for xq G M n , 


T(x o) = infjf > 0 : 5x1-1 satisfying (II. Ill withxfOl = xq, x(f) G 1C}, 


with the convention inf0 = +oo. When T(xo) is finite, it is the minimal time taken by the 
trajectories of F starting from xo to reach the target 1C. The set 1Z of points x G M n such that 
T(x) < +oo is called the reachable set. 

The regularity of the minimum time function T is a classical and widely studied topic in control 
theory. It is related to the controllability properties of the control systems as well as to the regularity 
of the target and the dynamics, together with suitable relations between them. It is well known 
that T is locally Lipschitz in 7Z if Petrov’s controllability condition is satisfied. However, in general, 
T is not everywhere differentiable even for a very smooth data. The strongest regularity property 
for T that we can expect, in fairly general cases, is semiconcavity. Here, a function is said to 
be semiconcave if it can be written as a sum of a C 2 function and a concave function. Therefore, 
semiconcave functions inherit many fine properties from concave functions. In this case, T is locally 
Lipschitz and a.e. twice differentiable. In m , Cannarsa and Sinestrari showed that the minimum 
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time function is locally semiconcave in 1Z\)C if Petrov’s condition holds and the target satisfies 
a uniform interior sphere condition , i.e., there exists r > 0 such that for any x £ 1C, there exists 
y £ 1C such that x £ B(y,r) C 1C. Due to the equivalence between Petrov’s condition and the 
Lipschitz continuity, T is no longer semiconcave if we remove Petrov’s condition. Therefore, it 
is natural to study the structure of the minimum time function under controllability assumptions 
which are weaker than Petrov’s condition. In m keeping uniform interior sphere conditon of 1C and 
assuming the continuity of T and the pointedness of the normal cones to the hypograph, Colombo 
and Nguyen showed that the hypograph of T is ip-convex for a suitable continuous function <p. This 
kind of regularity is weaker than semiconcavity. However, T keeps many regularity properies of 
semiconcave functions. The proof of the (^-convexity for the hypograph of T in i 17 was based on 
representations of the proximal supergradient and proximal horizontal supergradient of T. Removing 
the pointedness assumption, Nguyen showed in [23] that T still enjoys good regularity although 
the hypograph of T satisfies a weaker regularity called exterior sphere condition. 

It is worth remarking that all results above are dealt with the case where F is given in the form 
of a C 1)+ parameterization 

F{x) = {f(x,u) : u £ U}, x £ M n , 

with U C M m compact and f : R n x U — > M. n is of class C 1,+ . However, it is difficult to know when 
multifunctions admit smooth parameterizations (see [12] for a discussion). To get rid of finding 
smooth parameterizations for F, in m, Cannarsa and Wolenski developed a new approach, based 
on the nonsmooth maximum principle, to obtain semiconcavity results of the value function of a 
Mayer problem for the differential inclusion m- One essential assumption for this approach is 
the semiconvexity in the first variable of the maximized Hamiltonian H associated to F: 

H{x,p) := sup (v,p), (x,p) £ M n x M n . 

v£F(x) 

Adapting this approach to the optimal time problem, Cannarsa, Marino and Wolenski obtained 
semiconcavity results of T for (11,11) keeping the interior sphere condition of 1C and Petrov’ condition 
(seep]) . Later, some results for smooth parameterized control system were extended to nonpa- 
rameterized systems (see, e.g., lam 00 is]). In particular, in [8], Cannarsa and Nguyen extended 
the analysis of DUES] to the general system (D). More precisely, assuming the continuity of T, 
they showed that the hypograph of T satisfies an exterior sphere condition provided either 1C or 
F{x) satisfies an interior sphere condition for all x £ M n . 

In contrast to the semiconcavity type, there are few papers dealing with the semiconvexity type of 
the minimum time function. In [10], it was shown that the minimum time function for linear systems 
is semicovex if the target is convex and Petrov’s condition holds. Again for linear systems and convex 
targets, removing Petrov’s condition but assuming the continuity of T, Colombo, Marigonda and 
Wolenski showed in |16| that the epigraph ofT is ip-convex. Then T satisfies many good properties 
as listed in Proposition 12.31 Furthermore, in |T8] , the authors proved, for two dimensional nonlinear 
affine control systems and 1C = {0}, that the epigraph of T is (^-convex in a small neighborhood of 
the origin. The proof relies heavily on the (strictly) convexity of sublevel sets of T (in small time) 
and on the fact that every point sufficiently close to the origin is optimal, i.e., any trajectory steering 
a point to the origin optimally can be extended backwark still remaining optimal. To the best of 
my knowledge, there is no such type of regularity results for more general setting, e.g., for nonlinear 
control systems in high dimension, for differential inclusions with a general closed target. In this 


VARIATIONAL ANALYSIS AND REGULARITY OF THE MINIMUM TIME FUNCTION 


3 


paper, we will show, under suitable assumptions, that the epigraph of T, for nonparameterized 
control system ED, is y?-convex near the target (see Theorem 5.7). More precisely, we prove that 
if sublevel sets of T are uniformly <p o-convex for some constant <po > 0 then there exists a suitable 
continuous function ip such that the epigraph of T is y?-convex. Note that, in the proof, we do 
not need the optimality of points near the target. Futhermore, the proof is also based on some 
sensitivity relations. 

Sensitivity relations are an interesting and important object in control theory because of appli¬ 
cations to optimality conditions, optimal synthesis and regularity of the value function. They are 
typically given in the form of inclusions identify the dual arc as a suitable generalized differential 
of the value function. For the minimal time problem, the first results were presented in [1] which 
dealt with the smooth parameterized systems and the target having an interior sphere condition. 
In fact, for an optimal trajectory x(-) starting at a point xq £ 7Z, they proved that there exists (by 
maximum principle) a dual arc p(-) such that p(t) belongs to the Frechet superdifferential of T at 
x(t) for all t £ [0, T(xo)) if Petrov’s condition holds true at the end point x(T(x o)). This result 
was extended to nonparameterized systems in [7] by a different approach. It was proved in [5], for 
nonparameterized systems, that if Petrov’s condition holds at the end point x(T(x o)) then, for all 
t £ [0, T(cco)), p(t) belongs to the proximal superdifferential of T at x(t), otherwise p(t) belongs to 
the proximal horizontal superdifferential of T at x(t) for all t £ [0,T(xo))- Recently, in [Sj Cannarsa 
and Scarinci recovered the results of [5] for a general target. They also proved analogous inclusions 
for the proximal subdifferential extending the results, for smooth parameterized systems, obtained 
in m ■ More precisely, they showed that the proximal sub differential of T propagates along opti¬ 
mal trajectories except the terminal points. In the present paper, we obtain similar propagation 
results for both proximal subdifferential and proximal horizontal subdifferential of T (Corollary 14.71 
and 14.81) . In fact, we show that proximal subdifferential and proximal horizontal subdifferential of 
T propagate wholly along optimal trajectories. These are consequences of Theorem 14.51 and 14.61 
where we prove inclusions for normal cones to the epigraph and to the sublevel sets of the minimum 
time function. The proofs of these results are based on the relationship between normals to the 
epigraph and to sublevel sets of T via the value at relevant points of the minimized Hamiltonian h 
associated to F : 

h(x,p ) := inf (v,p), (x,p) £ M n x 

veF(x) 

It is proved in [19], for nonlinear control systems, that if x £ 7Z and if £ belong to the normal 
cone of the sublevel set 7 Z(T(x)) = {y £ M n : T(y) < T(x)} at x then (£, h(x, C)) is a normal to the 
epigraph of T at (x,T(x)). The proof was based on Maximum Principle. Note that, in that paper, 
besides standard assumptions, it is assumed, in a neighborhood of x, that T is continuous, optimal 
controls are unique and bang - bang with finitely many switchings, the sublevel sets are p-convex 
and every point is an optimal point. Under the same assumptions, in [24] , the reversed implication 
was proved, namely if iff, a) is a normal to the epigraph of T at (x,'T(x)) then £ is a normal to 
7Z(T{x)) and h(x,C) = a. In the present paper, we prove the same conclusions for very gerenal 
differential inclusions without using maximum principle. The proof is based on the representations 
of proximal horizontal subdifferential (Theorem 13.21 and 13.41) and proximal sub differential of T 
(Theorem 5.1 in [29]). Moreover, in Section [3] we prove a special feature of the minimum time 
function, that is, the normal cones to the epigraph of T at (x,T(x)) and to the sublevel 7Z(T(x)) 
at x have the same dimension. 
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The paper is organized as follows. In Section [2] we recall some notions and preliminary results 
needed in the sequel. Sectionals devoted to the variational analysis for the minimum time function. 
Section[I]concerns with sensitivity relations. The regularity of the minimum time function is studied 
in Section [5j 


2. Preliminaries 

2.1. Notations and basic facts. In this section we recall some basic concepts of nonsnrooth 
analysis. Standard references are in |13l 126] . 

We denote by | ■ | the Euclidean norm in M n , by (-, •) the inner product and by [x,y] the segment 
connecting two points x and y in M n . We also denote by B(x,r ) the open ball of radius r > 0 
centered at x, and the unit sphere in R n . We will use the shortened B = B(0, 1). For any 

subset E of M n , we denote by bdryE its boundary, by E its closure, by co E its convex hull and 
by coE its closed convex hull. A subset C of M n is called a cone if and only if Ax G C for any 
x £ C and A > 0. We say that k £ N is the dimension of a cone C if there exist v\, - ■ ■ ,v K £ C 
such that they are linearly independent and for any v £ C there exist Ai, - - - , X K > 0 such that 
v = Xivi H-1- X K v K . 

Let K C M n be a closed subset with boundary bdryAT. Denote by proj^(x) the projection of 
x £ on K. Given x £ K and v £ M n . We say that v is a proximal normal to K at x if there 
exists a = cr(x, v) > 0 such that 

(2.1) (v, y — x) < a\y — x| 2 , for all y £ K. 

We denote the set of all proximal normals to K at x by N^(x) and call it the proximal normal 
cone to K at x. 

Equivalently, v £ N^{x) if there exist constants C > 0 and r) > 0 such that 

(v, y — x) < C\y — x| 2 , for all y £ B(x, rj) n K. 

Observe that v £ N^(x) if and only if there is some A > 0 such that proj^-(x + Xv) = {x}. 
Notice that if K is convex, we can take a = 0 in ([2. ID . Hence the proximal normal cone to K at x 
reduces to the normal cone in the sense of Convex Analysis. 

The Clarke normal cone to K at x, Njl(x), is defined as 

Nj^(x) = co{v £ M n : 3xj —> x, 3vi —> v, Vi £ N^(vi)}. 

Let fl be an open set of M" and let / : D —> M U {+oo} be a lower semicomtinuous function. 
The domain of / is the set dom(/) := {x £ D : /(x) < +oo}, the epigraph of / is the set 
e pi(/) := {( x iP) G D x M : x £ dom(/),/? > /(x)}. Let x G dom(/). 

• The proximal subdifferential of / at x is the set 

d P f(x) := {v £ R n : (u,-1) G iV e ^ i(/) (x,/(x))}. 

Equivalently, 

d P f{x) := {v £ M n : 3c, p > 0 s.t f(y) - f(x) - (v,y - x) > -c\y - x| 2 , Vy G B(x, p)}. 

An element of d p f(x) is called a proximal subgradient of / at x. 

• The horizontal proximal subdifferential of / at x is the set 

<9°°/(x) := {v £ M n : (u,0) G N P i{f) (x,f(x))}. 

An element of d°°f(x) is called a proximal horizontal subgradient of / at x. 
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• The Frechet subdifferential of / at x is the set 

8-/0r) := f € R» : lim inf > 0 \ . 

\ y^ x \y-x\ ~ J 

An element of d~ f(x) is called a Frechet subgradient of / at x. 

• The Frechet superdifferential of / at x is the set 

x+tf \ / V f(y) - f( x ) - ( V >V - x ) / rX 

a fix) :=<d£1 : limsup-:-:- < 0 > . 

I «-►* \y-x\ J 

An element of d + f{x) is called a Frechet supergradient of / at x. 

Assume that / is Lipschitz around x. The Clarke’s generalized gradient of / at x is defined by 

df(x) := co{u £ R” : 3{yt} C 0 s.t. / is differentiable at yt,yi —> x,Vf{yf) —> v} 

For a mapping G : R n x R m — > R associating to x € M n and y £ M m a real number, we will denote 
by V X G, V y G the partial gradients (when they exist), and by d x G , d y G the partial generalized 
gradients. 

Let Q C M n be open. A function / : — > R is called semiconcave with semiconcavity constant 

c > 0 if / is continuous on Q and satisfies 

f(x + h) + f(x - h) - 2 f(x) < c\h\ 2 

for all x,h £ R n such that [x — h,x + h] C 0. We say that a function g : — > R is semiconvex if 

and only if —g is semiconcave. We recall below some useful properties of semiconcave functions 

Proposition 2.1. Let Ll C R n be open, f : —> R be a semiconcave function with semiconcavity 

constant c and let x £ fL Then f is locally Lipschitz on Ll and the followings hold true 
(1) p £ R n belongs to d + f(x) if and only if for any y £ Ll such that [y,x] C Ll, 

(2.2) f(y) — f (x) — {p,y — x) < c\y — x\ 2 
2) df(x) = d + f{x). 

If / is semiconvex, then (12.21) holds with the reversed inequality and the reversed sign of the 
quadratic term and the statement (2) holds true with the subdifferential instead of the superdiffer¬ 
ential. For further properties and characterizations of semiconcave/semiconvex functions, we refer 
the reader to El- 

Definition 2.2. Suppose K C R n is closed and <p : K —> [0, +oo) is continuous. We say that K is 
(p-convex if 

(2.3) (v,y-x) < ip(x)\v\\y - x\ 2 , 
for all x,y £ K and v £ N^(x). 

The case when ip = 0 in (12.31) is equivalent to the convexity of K. Therefore, (^-convexity is a 
generalization of convexity. Moreover, if the boundary of K is the graph of a C 1,1 function then 
K is yj-convex with ip is a suitable constant function. Functions whose epigraph is yxconvex enjoy 
good regularity properties which are similar to properties of convex functions. Denote by C n and 
FL d the Lebesgue n-dimensional measure and the Hausdorff d-dimensional measure, respectively. 
We recall here some regularity properties of functions whose epigraph is ^-convex (see El) 
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Proposition 2.3. Let C R n be open and let f : LI —» R be continuous and such that epi(/) is 
c p-convex for some suitable continuous function ip. Then there exists a sequence of sets Llh C Ll 
such that Qh is compact in Ll and 

(i) the union of Llh covers C n -almost all Ll; 

(ii) for all x £ U hQh, there exist 5 = 5(x) > 0, L = L(x) > 0 such that f is Lipschitz on B(x, 6) 
with ratio L, and hence semiconvex on B(x,6). 

Consequently, 

(iii) f is a.e. Frechet differentiable and admits a secon order Taylor expansion around a.e. point 
of its domain. 

Moreover, the set of points where the graph of f is nonsmooth has small Hausdorff dimension. 
More precisely, 

(iv) for every k = 1 , ■ ■ ■ , to, the set {x £ intdom(/) : dim d p f(x) > k} is countably TL n ~ k - 
rectifiable. 

Finally, 

(v) / is locally bounded variation in LI. 


2.2. Differential inclusions and the minimum time function. Let F : R n R n be a given 
multifunction. We consider the differential inclusion, for T > 0, 


x(s) £ F(x(t)), a.e. t £ [0, T] 

x(0) = xq £ R n 


A solution of (12.41) is an absolutely continuous function x(-) defined on [0, T] with initial value 
x(0) = xo- We also say that x(-) is a trajectory of F starting at x. The notion x(t) refers to the 
derivative of x(-) at the time t and is the right derivative if t = 0 . 

Throughout this paper, we require the following assumptions on the multifunction F. 

Assumption (F). 

(FI) F{x) is nonempty, convex, and compact for each x £ ML. 

(F2) F is locally Lipschitz, i.e. for each compact set K C R n , there exists a constant L > 0 such 
that 

F(x) C F(y) + L\y — x|B, for all x,y £ K. 


(F(3) there exists 7 > 0 such that max{|u| : v £ F(x)} < 7(1 + |x|), for all x £ M n . 

The following theorem gives some information regarding C 1 trajectories of F under assumption (F) 
which will be useful in the sequel 


Theorem 2.4 (see, e.g., [29]). Assume that assumption (F) holds true. Let K C be compact. 
Then there exists T > 0 such that associated to every x £ K and v £ F(x) is a trajectory x(-) 
defined on [0, T] with x(0) = v. Moreover, for all t £ [0, T], we have \x(t) — v\ < Mt, for some 
constant M independent of x. 


We now assume that a closed subset /C of M n is given which is called the target and F : W 1 R n 
is a multifunction. We define the minimum time function T : R” [0, + 00 ] as follows. If x 0 /C 
then 


(2.5) 


T(x) := inf{T > 0 : 3x(-) satisfying (12.41) with x(0) = x,x(T) £ 1C}. 
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If there is no trajectory of F starting at x can reach /C, then T(x) = +oo as the usual convention. 
If x £ 1C then we set T(x) = 0. 

It is well known that under (F), the infimum in (12.51) is attained and the minimum time function 
T is lower semicontinuous (see, e.g., [129]). 

For t > 0, the reachable set at time t is the set 

K(t) : = T(x) < t}, 

the reachable set is the set 

71 : = {x £ M” : T{x) < +oo} = \J 7Z{t) 

t> 0 

and the attainable set from 1C at time t is the set 

A(JC,t) := {x(t) : x(-) solves (12.41) with s(0) £ K,}. 

Note that, under assumption (F), 7Z(t) and A(IC,t) are compact for every t (see, e.g.,pQ). 

3. Variational analysis results 

This section is devoted to the variational analysis of the minimum time function for differential 
inclusion under assumption (F) only. Recall that the minimized Hamiltonian associated to F is the 
function h : M n x M” —> R defined by 

(3.1) h(x, C) = min (v,() Vx,CeR n - 

veF(x) 

In [59], the authors proved the following interesting characterizations of the proximal subdifferential 
of the minimum time function T at points inside the target as well as outside the target. 

Theorem 3.1. |29j Assume that the multifunction F satisfies assumption (F). 

(a) For all x € 1C, we have 

d p T{x) = n£(x) n {( e M" : h(x, C) > -l}. 

(b) Whenever r > 0 and T{x) = r, then we have 

d P T(x ) = N p [r) {x) n {C € r : h(x,C) = -!}• 

One can also proves similar characterizations for the proximal horizontal subdifferential of the 
minimum time function. We first prove the result for points belonging to the target. 

Theorem 3.2. Assume (F). Let xq £ 1C. It holds 

(3.2) d°°T(xo) = N p (s 0 ) O {C € M n : h(x 0 , () > 0}. 

Proof. Let ( 6 d°°T(x o). Then (C,0) £ N£ pi ^( xq.F(xq). Thus there exist a > 0, > 0 such that 

(3-3) {(,y~x 0 ) < a (\y - x 0 \ 2 + fi 2 ) , 

for all y £ B(xo,r/) and fi > T(y). 

Taking y £ B{xq, rj) D 1C and = T(y) = 0 in (13.31) . we have 

(C,y - %o) < o-\y - x 0 | 2 . 
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It follows that ( G N^(xq). 

We are now going to show that h(xo,C) > 0. Let w G F{x o) be such that 

(C,w) = h(x 0 ,C) = min ((,v). 

vGF(x o) 

By Theorem 12.41 there exists a C 1 trajectory y(-) on [0, T], for some T > 0, of — F satisfying 
y(0) = xq and y( 0) = — w. By Gronwall’s Lemma, there is some constant M > 0 such that 
| y(t) — xq\ < Mt for all t G [0, T]. 

There are two possible cases. 

Case 1. There exists e > 0 such that y(t) G JC n B(xo,rj) for all t G [0, e]. For t G (0, e), taking 
y := y(t) and (3 := T(y(t)) = 0 in (13.31) . we have 

((, y(t) - x Q ) < a\y(t) - x 0 | 2 < cr Mt 2 , 


or, equivalently, 



y{t) - x 0 \ 

t i 


< crMt. 


Letting t —> 0+ in the latter inequality and using the fact that y(-) is of class C 1 with y(0) = —w, 
we get (C,—w) < 0. Therefore, h(xo, () = ((,w) > 0. 

Case 2. There exists e > 0 such that y(t) /C for all t G (0, e]. Fix t G (0, e) such that 
y(s) G B(xo,rj) for all s G [0, t]. Set x(s) = y(t — s),s G [0, t\. Then x(-) is a trajectory of F with 
x{t) = xq. By the principle of optimality, we have 


T(y(t)) = T(x 0 ) < t. 

Taking y := y(t),j3 := t > T(y(t)) in (13.31) . we have 

((, y{t) - Xq) <a (I y(t) - x 0 | 2 + t 2 ) < a(M + l)t 2 . 


or, equivalently, 

Afc-WiM+i),. 

Letting t —> 0+ in the latter inequality and using the fact that y(-) is of class C 1 with y( 0) = —w, 
we get ((, —w) < 0 . Therefore, h(x o, C) > 0 . 

Now let C G Ff£(x o) be such that h(x o,C) > 0- We are going to show that ( G d°°T(x o), i.e., 
there is some a > 0 such that 


(C, y-x 0 ) <a (|y - x 0 \ 2 + /3 2 ) , 
for all (y,/3) G epi(T),y G dom(T). 

Let y G dom(T) be arbitrary. Set T := T(y). Let x(-) be an optimal trajectory for y. Set 
x\ = x(T). Then x\ G 1C. By Gronwall’s Lemma, we have, for each t G [0,T], 

I x(t) - x 0 \ < |x(t) -y\ + \y- x 0 \ <Mt+\y- x 0 |. 

Since x\ G /C, C G N£ (xq). there is some a\ > 0 such that 

(3.4) (C,xi - x 0 ) < <7i|xi - x 0 | 2 < cri (MT + | y- a: 0 |) 2 . 

Let y(-) be a measurable function which is the projection of x(-) on the set F{x o) restricted to 
[0, T], i.e., for all most t G [0, T], 


y{t) = proj F(a:o) (x(t)) G F(x 0 ). 
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Since F is locally Lipschitz, 

(3.5) \y(t) — x(t)\ < L\x(0) — x(t)\ < LMT + L\y — xq\, a.e.t G [0,T], 

Using (13.41) and (13.51) . we have the following estimation 

{(,y~x 0 ) = (C,y ~xi) + (C,xi-x Q ) 

i T 

< - 


< - 


(C, f x(t)dt) + <7i(MT + | y - x 0 |) 2 
Jo 

r T r T 

/ (C ,y(t))dt+ {C,y(t) - x(t))dt + cri(MT + \y - x 0 \Y 

Jo Jo 

K x oX)T + [ K\\y{t) - x(t)\dt + ai(MT + \y - x 0 \) 2 
Jo 


< ICI [LMT 2 + L\y - xo\T) + a\(MT + | y- x 0 \) 2 

< cr (|y — xo| 2 + T 2 ) , for some a > 0 


Therefore ((,y — xo) < a (\y — xo| 2 + /3 2 ), for all j3 > T = T{y). It concludes that ( G d°°T(x o). 
This ends the proof. □ 

Theorem 3.3. Assume (F). Let xo G 7 Z\IC and C G -^7^(T(xo))( x o)' ® ne h as M x 0 )C) < 0. 

Proof. Since C G ^tz(T(x 0 ))( x o)’ there exists cr > 0 such that 

(3.6) (C,y - x 0 ) < u|y ~ x 0 | 2 , 

for all y G TZ(T(xo)). 

Let x(-) be an optimal trajectory for xo- Then x(t) G TZ{T{xf)) for all t G [0,T(xo)]. Let y(-) 
be the measurable function which is the projection of x(-) on F(x o) restricted to [0, 7~(xo)]. By 
Gronwall’s Lemma and by the Lipschitzianity of F, we have 

|x(t) — y(t) | < L|x(f) — xo| < LMt, for a.e. t G [0, T(xo)]. 

For t G (0, T(x)), taking y := x(t) in (13.61) . we have 

(C, x(t) - x 0 ) < a\x(t) - x 0 | 2 , 

or, equivalently, 

(C, [ x(s)ds) < aMt 2 . 

Jo 

We have, for t G (0,T(xo)), 

h(x 0 ,C)t < [ (C ,y(s))ds < crMt 2 + [ (C ,y(s) - x(s))ds 

Jo Jo 

< aMt 2 + ML |C| [ tds < aMt 2 + ML\(\t 2 
Jo 

This implies that h(x o,C) < 0 . The proof is complete. □ 

Theorem 3.4. Assume (F). Let xq £1Z\1C. We have 

d°°T(x 0 ) = 7V£ (r(a: 0 ))(xo) n {( G I n : h(x o, C) = 0} . 
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Proof. Let ( £ <9°°T(xo). Then there exists a > 0 such that 

(3-7) (C,y-x 0 ) < a (\y - x 0 \ 2 + \/3 - T(x 0 )\ 2 ) , 

for all (y,/3) £ epi(T). 

From (1T7D . one has 

(C,y~ x o) < o'I V - x o\ 2 , 

for all y £ 77(T(x 0 )), i.e., C G N^ r{xo)) (x 0 ). 

It follows from Theorem 13.31 that h(x o,C) < 0 . We are going to show that h(x o, C) > 0- Let 
w £ F{x o) be such that 

(w,() = h(x 0 ,C) = min (v, (). 

v&F(x o) 

There exists a C 1 trajectory x(-) of — F on [0, T] for some T > 0 such that x(0) = xo and x(0) = —w. 
Since xo fL 1C, there exists s > 0 such that x(t) 0 1C for all t £ [0, e]. Fix t £ (0, e). For s £ [0, t], we 
define y(s) = x(t — s). Then y(-) is a trajectory of F. By the principle of optimality, we have 

T(x(i)) = T(y( 0)) < T(y(t)) + t = T(x 0 ) + 1. 


Taking y := x(t),/3 := T(xo) +1 in (13.71) . we get 

(C, x(t) - x 0 ) < a (|x(t) - x 0 | 2 + t 2 ) < a(M + 1 )t 2 , 


or, equivalently, 




< cr(M + 1 )t. 


Letting t —> 0+ in the both sides of the latter inequality, we obtain (£, —w) = (C,x(0)) < 0. Hence 

H x o,C) > 0 . 

Now let C £ N£ {r{xo)) {x 0 ) with h(x o,C) = 0. We will show that ( £ d°°T(x o), i.e., there exists 
a constant a > 0 such that 


(3.8) 


(C ,y- xo) < O (\y - x 0 | 2 + 1/3 - T(x 0 )| 2 ) , 


for all (y,/3) £ epi(T). 

Let y £ dom(T) be arbitrary. We have two possible cases 

Case 1. T(y) < T(xo). Then y £ 77(T(xo)). Since f £ N^,t( Xo ))( x o), there exists <xi > 0 such 
that 

(C ,y~ x 0 ) < o-i|y - x 0 | 2 , 

i.e., (13.81) holds for a = <j\. 

Case 2. T{y) > T(xo). Let y(-) be an optimal trajectory for y. Then by the principle of 
optimality, 

T(y) = T(y(t)) +t for all t £ [ 0 ,T(y)]. 


Set r = T{y) — T(xo) and x\ = y(r). Then T(xi) = T(xo) and thus xi £ TZ(T(xo)). There is some 
ui > 0 such that 

(C ,y~ x 0 ) < o-i |y - x 0 | 2 . 


By Gronwall’s Lemma, we have, for t £ [0, T(y)\, 


I y{t) - x 0 | < \y{t) - y\ + \y - x 0 | < Mt + \y - x 0 


In particular, |xi — xq| < Mr + \y — xq 



VARIATIONAL ANALYSIS AND REGULARITY OF THE MINIMUM TIME FUNCTION 


11 


Let z(-) be the mesurable function which is the projection of y(-) on F(x o) restricted to [0, T(y)\, 
i.e., 


z(t) = proj F ( X0 )ij(t), for all most t € [ 0 ,T(y)\. 

By the Lipschitz continuity of F, 

(3.9) j y(t) — z(t)\ < L\y(t) — xo| < LMt + L\y — xo|, for all most t £ [0, T(y)\. 

We have the estimation 


(C,y~xo) = 
< 


< 

< 

< 

< 

< 


iC,y-xi) + ((,xi -x 0 ) 

rr 

— (Ci / y(t)dt) + ai\xi - x 0 \ 2 

J o 

rr rr 

— (Ci / z(t)dt) + (C, / (z(t) - y(t))dt) + <7i\xi - x 0 \ 

Jo Jo 

rr 

-h(x 0 ,C)r+\C\ / \z(t) - ij(t)\dt + cri\xi - x 0 \ 2 
Jo 

rr 

ICI/ (LMr + L\y - x 0 \)dt + ai\xi - x 0 \ 2 
Jo 


L\C\(Mr 2 + | y- x 0 \r) + ai(Mr + | y- a ; 0 |) 2 
<?(\y ~ x 0 \ 2 + r 2 ) = a(\y - x 0 | 2 + | T(y) - T(x 0 ) | 2 

a (\y — x o\~ + 1/3 - T(x 0 )| 2 


for some cr > 0 and for all (3 >T(y) > T(xq). This ends the proof. 


□ 


Corollary 3.5. Assume (F). We have 

N nn*))( x ) = ® +d p r(x ) u d°°T(x), 

for x £1Z\IC. 

Proof. Let £ £ N^^^Ax). Then by Theorem 13.31 we have /i(x,£) < 0. If h(x,Q) = 0, then by 
Theorem l3.41 £ £ d°°T(x). If h(x, £) < 0, then we set r/ = — C/h(x, £). Observe that ry £ N^ T ^(x) 
and h(x,rj) = —1. It follows from Theorem 13. II that rj £ d p T(x). Thus £ = —h(x,() r l £ M. + d p T(x). 
Therefore N^ r ^ t ,^(x) C M+(9' P T(x) U d°°T(x). The oposite inclusion follows easily from Theorem 
m Theorem 13.11 and the definition of a cone. □ 


The following theorem gives a connection between normal cones to reachable sets and normal 
cones to the epigraph of the minimum time function. This result was proved in mm for nonlinear 
control systems, under very strong assumptions, using Maximum Principle. 


Theorem 3.6. Assume (F). Let x €TZ\JC. 

(i) ifC G N p {t{x)) (x), then (£,%,£)) £ N p pi{T] (x,T(x)). 

(ii) if C £ and a £ R satisfy (£,a) £ N p pi ^(x, T(x)), then a < 0 , £ £ and 

h(x, £) = a. 

Proof, (i) Since £ £ N^ T ^(x), it follows from Theorem 13.31 that h(x,C) < 0 . There are two 
possible cases 

(a) Case 1: h(x,Q = 0. Then by Theorem 13.41 £ £ d°°T(x), i.e., (£,h(x,£)) = (£,0) £ 

^epi(T)( x ’ T ( x ))- 
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(b) Case 2: h(x,() < 0. Set £i = — ^(xQ - Observe that £i G and h(x,( l) = —1- It 

follows from Theorem 13.11 that £i € d p T{x ), i.e., (£i,—1) G N p p ^^(x. T(x')). Thus (C,h(x,£)) = 

— h(x, C)(Cl5 ~1) G IV c ^ i(r) (x,r(x)). 

(ii) Since (£,«) € N^ )i ^(x,T(x)), by the nature of an epigraph, one has a < 0. We also have 
two possible cases 

(a) Case 1: a = 0. Then (£,0) G N p pi ,j^(x,T{x)), i.e., £ G d°°T(x). Thanks to Theorem 13.41 
C G IV£ (r(x)) (x) and h(x, £) = 0 = a. 

(b) Case 2 : a < 0. Set Cl = -§■ Then (Ci,-1) = -^(C,a) G N p pi{r) (x,T(x)), i.e., (£i G 

d p T(x). It follows from Theorem 13.11 that £i G ^ti(T(x ))( x ') an d M x >Ci) = —1- Therefore £ = 
-aCi G N p ^ r ,^(x) and h(x, £) = -ah(x, Ci) = a. □ 

Lemma 3.7. Assume (F). Let x G 1Z\K. One has 

N K(T(x ))( x ) = i°} and onl y */ N epi(T)( x ’ r ( x )) = {°}- 

Proof. Suppose A T k(T(x))( x } = {0}- We will show that N P t -^(x,F(x)) = {0}. Assume, to the 
contrary, that N p pi ^(x,T(x)) 7 ^ {0}. Let £ G M n ,a G M be such that (£,a) G N p pi ^(x,T(x)) and 
(£,a) 7 ^ (0,0). From Theorem 13.61 we have £ G N^ T ^( x ) and /i(x,£) = a. Since ^(x) = 

{0}, we get C = 0 and then a = /i(x,£) = 0. This contradicts to (£,a) 7 ^ (0,0). 

We now assume that N p pi ^(x,T(x)) = {0}. Let £ G N^j-^(x). Again from Theorem l3.6l one 
has (£,/i(x,£)) G A jP p](r ^(x,T(x)) = {0}. This implies £ = 0. Therefore N^ T ( X ))( X ) = {0}. □ 

The following is a special feature of the minimum time function. In general, it may not hold even 
for convex functions. This result was proved in [20] in the case of normal linear control systems 
using bang - bang principle. 

Theorem 3.8. Assume (F). For any x G TZ \ 1C, we have 

(3.10) dim N p {nx)) (x) = dim N P i{T) (x,T(x)). 

Proof. By Lemma [3.71 it is enough to show that (13.101) holds true when N^j-^{x) / {0} and 
N p p .^r)(x,T(x)) 7 ^ { 0 }. Assume that dim {x) = k > 1 and dim N p pi ^(x,T(x)) = £ > 
1. We now assume that £i,--- , £ K G and they are linearly independent. It follows 

from Theorem 13.61 that (£i, h(x, £i)), • • • , (£ K , h(x, £ K )) G N p pi ^(x,T(x)). One can see easily that 
(£i, h(x, £i)), • • • , (£k, h(x, £k)) are linearly independent. Thus n < £. 

Let us now assume that (r/i, au), • • • , (%, af) G N p pi ^(x,T{x)) are linearly independent. Thanks 
to Theorem 13.61 rji, ■■■ G N^ T ^(x) and h(x,r]i ) = a* for all* = 1, ■ ■ ■ ,£. Observe that rji 0 
for all i = l,-- - ,£. Indeed, if rji = 0 for some i G {1, • • - ,£} then cu = h(x,r}i) = 0. Thus 
(771 , «i), • • • , (j]£, ae) are not linearly independent. We are going to show that 771 , ■■ ■ , rj£ are linearly 
independent. Assume, to the contrary, that there exists 01 , ■ ■ ■ , ai G K such that a\ + ■ ■ ■ + aj 7 ^ 0 
and 

t 

(3.11) Y ajr]i = 0. 

i— 1 


Set 


I = {i : 1 < i < £, ai > 0}, and J = {1, • • • ,£}\L 
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If I and J are both nonempty, then (13.111) implies that 

(3.12) y ai rn = 

iei j&J 

Since a* > 0 and ( rp , a) £ N^ pi ^(x,T(x)) for all i £ I, we have 

= ^^(r^a;) <E A^ i(r) (x,T(x)). 


\i£l iel 

It follows fromTheorem ITTTTT1 that 


iei 


h x, ^2 a iVi = Y^Oj. 
\ iel / i&I 


Similarly, there holds 


h ( x, - y CLirjj 
j&J 


— yy a j a j- 

i&J 


The last two equalities together with (|3.12|) claim that 

l 

^ ( diOZ-i — 0 . 

Since 


2=1 


(r/i, 


on) = 


Z=1 


yaw, 'yam J =(0,0), 

\i= 1 z= 1 / 

and (q i, oq), • • • , (rj£, at) are linearly indepentdent, we get a* = 0 for all i £ {1, ■ ■ • ,£}. This is a 
contradiction. 

Similarly, one gets a contradiction if either J = 0 or / = 0. The proof is complete. □ 


4. Sensitivity relations 

In this section, we use the results obtained in Section[I]to derive some sensitivity relations. To do 
that, besides assumption (F), we need to assume some assumptions on the maximized Hamiltonian 
H : xK"aM associated to F which is defined as follows 

(4.1) H(x,p) = max (v,p), Vr,pGl". 

v€ F(x) 

Assumption (H). For every r > 0 

(HI) there exists c > 0 so that for every p £ § n_1 , the mapping s H > H(-,p) is semiconvex with 
semiconvexity constant c; 

(H2) \7 p H(x,p ) exists and is Lipschitz in x on B{ 0, r), uniformly for p £ M n \ {0}. 

Assumptions (H) was introduced for the minimum time propblem in [Bj. The following are some 
consequences of assumptions (F) and (H). 

Proposition 4.1. (see, e.g., [T2JJ Assume (F) and (H). For 0 / p £ M n and x £ M n , one has 

(4.2) dH(x,p ) C d x H(x,p) x d p H(x,p ) 
and 

(4.3) V p H(x,p ) € F(x), (V p H(x,p),p) = H(x,p). 

Moreover, \7 p H(-,p ) is Lipschitz continuous. 
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Lemma 4.2. [ 8 j Let G : [0, T] x W 1 =$ M n be an upper semicontinuous multifunction. Assume 
G(t, ■) satisfies assumption (F) uniformly in t £ [0, T] and is such that for some Kq > 0, 

M < K 0 \p\, to € G(t,p), V(t,p) € [0,T] x R n . 

Let p(j be a solution of the differential inclusion 


(4.4) 


Then, 


p(t ) £ G(t,p(t)), a.e. t £ [0,T] 

P( 0) = Po- 


e- Kot \ P m < \p(t)\ < e Kot \p( 0)|, Vt G [0 ,T\. 

Moreover, for all 0 < t\ < t 2 < T, 

e -Ko(t2-ti)\ p ^\ < | p(tl) | < 


and 

\p(t 2 ) -p(ii)| < Koe K °( t2 ~ tl \t2 -ti)\p(t 2 )\. 
We recall Maximum Principle in the following form 


Theorem 4.3. Assume that (F) and (Ft). Let xq € TZ \ 1C. Suppose x(-) is an optimal trajectory 
starting at xq. Then there exists an absolutely continuous arc p : [0,T(xo)] —>• M n , never vanishing, 
such that 


(4.5) 


x( s ) = V p H(x(s),p(s)), 
~p{s) € d x H(x(s),p(s), 


a.e. s £ [0,T(x 0 )], 


and the transverality condition 

p{T(x 0 )) £ Ng(x(T(x o)). 


Proof. From Theorem 3.5.4 in [2] and (14.211 . 


□ 


An absolutely continuous function pf) satisfying the system (14.511 and the transversality condition 
is called a dual arc associated to the trajectory x(-). From (14.31) . we have 


(4.6) H(x(t),p(t)) = (x(t),p(t)), for a.e. t £ [0,T(x o )]. 


We remark that, under our assumptions, if (x,p) solves the Hamiltonian inclusion 


(4.7) 


x( s ) = V p H(x(s),p(s)), 
-p(s) £ d x H(x(s),p(s), 


a.e. s £ [0, T], 


then there are two possible cases: 

(a) neither p(s) 0 for all s £ [0, T]. 

(b) or p(s) = 0 for all s £ [0, T], 

Moreover, let r > 0 be such that x([0, T]) C B(0,r) and let K = K(r) be a Lipschitz constant of 
F on B(0,r), we have 

\fi(s )I < K\p(s )|, a.e. s £ [0, T], 

(see, e.g., m for detailed discussion). 

Finally, we recall following result which is useful in the sequel. 
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Lemma 4.4 (see, e.g, j8j). Assume (F) and (H), and let p(-) be an absolutely continuous arc on 
[0, T] with p(t ) 7 ^ 0 for all t G [0, T]. Then for each x G M n , the problem 


(4.8) 

has a unique solution. 


x(t) = V p H(x(t),p(t)), 
x(0) = x, 


a.e. t G [0, T], 


The following result can be seen as the propagation of the normals to the epigraph of the minimum 
time function along optimal trajectories. 

Theorem 4.5. Assume (F) and (H) and given xq £ 1Z\1C. Let x : [0, T{xq)\ — > M n be an optimal 
trajectory for xq and let p : [0, T(xq)\ —>• M n be an arc such that (x,p) is a solution of the system 


(4.9) 


x(s) = V p H(x(s), P (s)), ^ s g 

-p(s) G d x H(x(s),p(s), 


satisfying cc(0) = x 0 and (~p(0), h(x 0 , -p(0))) G NB (t) (x 0 , T(x 0 )). Then for all t G [0,T(x 0 )), 

(-P(t),h(x(t),-p(t))) G N[ pi{r) (x(t),T(x(t))). 

Moreover, h(x(t),—p(t)) = h(xo,—p(0)) for all t G [0,T(xo)]. 

Proof. We first note that if p{t) = 0 for all t G [0, T{x<fj\ then the conclusion is trivial. We now 
suppose p{t) / 0 for all t G [0, T{xq)\. Set a = h(xo,—p(0)). Since (—p(0),a) G (x'o, T (x'o)), 

there exist C > 0 and 77 > 0 such that 


(4.10) 


(~p(0),y~ x 0 ) +a(j3 - T(x 0 )) < C (\y -x 0 | 2 + \/3 -T{x 0 )| 2 ) , 


for all (y, /3) G epi(T) with y G B(x 0 , rf). We fix t G (0, T(xo)). Note that x(-) is the unique solution 
of the system 


(4.11) | 
For h G -B(0,77), let Xh : [0,1] 

(4.12) | 


x(s) = V p H(x(s),p(s)), f [n , 

x(t) = x(t), tor s G [U, tj. 

—> M n be the solution of the equation 
x( S ) = Vpff(x( S ), #(„)), forse[ot] 


I x(l) = x(l) + h, 

Then by using Gronwall’s Lemma, one can show that there exists k > 0 independent of t such that 

(4.13) l^ft(s) — x(s)| < n\h\, for all s G [0,1]. 

We can choose 77 > 0 sufficiently small such that a^QO, 1]) fl 1C = 0 for all h G B(0,y). By the 
principle of optimality, 

T{x 0 ) = T{x(t )) + 1, 

and 

T(x h ( 0 )) < T(x h (t)) + t. 

For p > T(xh{t)), we have 

T(x h (0)) <P + T{x 0 ) - T(x(l)). 

In (14.101) . taking y := Xh( 0),:= /3 + T{x 0 ) — T(x(l)), we obtain 

(4.14) (~p( 0),x h (0) - x(0)) < -a(P - T(x(t))) + C (lx h (0) - x(0)! : - + \j3- T(x(t)) | 2 ) . 
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It follows that 

(-p(t),x h (t) - x(t)) = (-p(t),x h (t) - x(t)) + (p(0), x h (0) - x(0)) + (-p(O), x h (0) - z(0)) 

< (-p(t),x h (t) - x(t)) + (p(0),x h (0) - x(0)) 

(4.15) -a(j3 - T(x(t))) + C (|^(0) - x(0)| 2 + |/3 -T(x(t)) | 2 ) . 

We have 

(~p(t),x h (t) - x(t)) + (p(0),x h (0) - x(0)) = ^-{-p(s),x h (s) - x(s))ds 

= / ((-p{s),x h (s) - x(s)) + {-p{s),x h (s) - 5(s)))ds 

Jo 

(4.16) = [ {-{p(s),x h (s) - x(s)) - H(x h (s),p(s)) + H(x(s),p(s))) ds. 

Jo 

Since —p(s) £ d x H(x(s),p(s)) a.e. in [0,T(xo)]> it follows from assumption (HI) and Proposition 
12.11 that 

(-p(t),x h (t) - x(t)) + (p(0),x h (0) - x( 0)) < Ci f \p{s)\\x h (s) - x(s)\ 2 ds 

Jo 

(4.17) < C 2 \h\ 2 = C 2 \x h (t)-x(t)\ 2 , 

where Cl > 0, C 2 > 0 are suitable constants independent of t. 

From (14.151) - (14.171) . we have for all h £ B(0,p),/3 > T(xh(t)), 

(4.18) (~p(t),x h (t) - x(t)) + a(/3 -T(x(t))) < K(\x h {t) - x(t)\ 2 + \/3 - T{x(t)) | 2 , 

where K > 0 is a suitable constant. This implies that (— p(t),a ) £ N^ pi ^(x(t),T(x(t))). Thanks 
to Theorem 13.61 a = h(x(t), —p(t)). Since t £ (0,T(xo)) is arbitrary, we have 

(~P(t), h(x(t), -p(t))) £ N^ i(r) (x(t),T(x(t))) and h(x(t), -p(t)) = h(x 0 ,-p(0)), for all t £ [0,T(x 0 )). 
Moreover, by continuity, we have 

h(x(t),—p(t)) = h(xo,—p(0)), for all t £ [0, T{xq)\. 

The proof is complete. □ 


Theorem 4.6. Assume (F) and (H) and given xq £ TZ \ 1C. Let x : [0,T(xo)] —> W 2 be an optimal 
trajectory for xq and let p : [0, T(xq)\ —>• M n be an arc such that (x,p) is a solution of the system 


(4.19) 


x(s) = V p H(x(s),p(s)), 

-p(s) £ d x H(x{s),p(s), 


a.e. s £ [0,T(s 0 )], 


satisfying x(0) = xq and —p( 0) € t ^ xq ^(xq). Then, for all t £ [0, T(xq)\, 

-p{t) £ N% msm (x(t)). 


Proof. Since —p( 0) £ N^^j-^ xo ^(xq), by Theorem 13.61 we have 

(-p(o),M® 0 ,-p(o))) £ < i(r) (x 0 j r(x 0 )). 

By Theorem 14.51 (—p{t),h(x{t), —p(t))) £ TJ^(j^(x(t),Tix(t))), for all t £ [0,T(xo))- Hence again 
by Theorem 13.61 —p(t) £ for all t £ [0, T(xq)). Set T = T(x 0 ). In order to finish 

the proof, we only have to show that —p{T) £ N^{x(T)). The arguments follow the lines of the 
proof of Theorem 14.51 
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Since —p(0) G (x'o), there exist Co > 0 and po > 0 such that 

(4.20) (-p(O), Vo ~ xo) < C'olyo - x 0 \ 2 , 


for all y 0 £ 7 Z(T) n B(x 0 , r/ 0 ). 

Now let y £ 1C (1 B(x(T),r} o) and set h := y — x(T) £ B( 0, r/o). Let Xh : [0, T] —> R n be the solution 
of the system 


(4.21) 


x(s) = V p 7L(x(s),p(s)), 
x(T) = x(T) + /i, 


Recall that x(-) is the solution of the system 


for s £ [0, T], 


(4.22) 



V p H(x(s),p(s)), 

x(T), 


for s £ [0, T], 


Then there exists a constant Kq > 0 such that 


(4.23) \x h {s) - x(s)\ < K 0 \h\, V s £ [0, T]. 

Since Xh(T) = y £ JC, T(xh( 0)) < T. That is 2^(0) £ TZ(T). Thanks to (|4.23l) . 

x h (0) £ 1Z(T) n B(x 0 , 770). 


Thus 


(4.24) (-p(0),x h (0) - x(0)) < ^^^(O) — cu(0)| 2 . 

Moreover, arguing as in the proof of Theorem 14.51 we have, for some constant K\ > 0, 

(4.25) (-p(T),x h (T) - x(T)) + (p(0),x h (0) - x(0)) < K^x^T) - x(T)\ 2 . 

Therefore, 

(~p(T),x h (T) - x(T)) = (—p(T),x h (T) - x(T)) + (p(0),x h (0) - x(0)) + (-p(0),x h (0) - x(0)) 

(4.26) < C\x h (T)-x(T)\ 2 . 

Since Xh(T) £ B(x(T),r] 0 ) D JC, the latter inequality implies that —p{T) £ N£(x(T)). This ends 
the proof. □ 


Corollary 4.7. Assume (F) and (H) and given xq £l Z\JC. Let x : [0,T(xo)] — > R n be an optimal 
trajectory for xq and let p : [0, T(xq)\ —> R n be an arc such that (x,p) is a solution of the system 

(a ovi / *( s ) = Vpif(x(s),p(s)), 

(4 ' 27) 1 -f(,) e “' e ' se|0 ’ r(xo)1 ' 

satisfying x(0) = xq and —p{0) £ d p T(x 0 ). Then, for all t £ [0,T(xo)], 

—p{t) £ d P T(x(t)), and h(x(t),—p(t)) = —1. 


Proof. Since -p( 0) £ d p T{x 0 ), (~p{ 0), —1) € N p pi{r) (x 0 ,T(x 0 )) and h(x o ,-p(0)) = -1. By 
Theorem 14.51 we have (—p(t),— 1) £ N^ i ^(x(t),T(x(t))) for all t £ [0, T(xo)). That is, —pit) £ 
0 p T(x(t)) for all t £ [0, T(xo)). Moreover, since — p(0) £ N£^ Xq ^(x 0 ), by Theorem 14.61 we have 
—p(T) £ NJq{x{T)). Together with h{x{T), — p{T)) = —1, by Theorem 13.11 one has —p(T) £ 
d p T{x{T)). □ 


Similarly, one has 
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Corollary 4.8. Assume (F) and (H) and given xq G 1Z\1C. Let x : [0,T(®o)] —t be an optimal 

trajectory for xq and let p : [0,T(®o)] —> M n be an arc such that ( x,p ) is a solution of the system 


(4.28) 


x{s) = V p H(x(s),p(s)), 


a.e. s G [0,T(® 0 )], 


[ -p(s) G d x H(x(s),p(s), 
satisfying x(0) = xq and —p(0) € d°°T(x o). Then, for all t G [0,T(xo)]> 

—p(t) G d°°T(x(t)), and h(x(t), —p(t )) = 0. 


5. Regularity of the minimum time function 

In this section, we apply results in Section[3]and Section [5] to study the regularity of the minimum 
time function. 

For 6 > 0, set S(6) = 71(5) \ K.. 

Assumption (R(5, po)). If T is continuous in 5(d), then there exist constants 5 > 0 and po > 0 
such that TZ(t) is <y9o-convex for all t € [0, <5]. 

Proposition 5.1. Assume (F), (FI) and (R(5,po)). There exists a continuous function ip such 
that the epigraph of T\s( 5 ) is p-convex. 

Proof. We first prove that there exists a constant C = C(6,po) such that for all x,y G S(5) and 
(C,«) 6 (T)(a;,T(x)), there holds 

(5.1) (((,a), ( y,T(y )) - (x,T(x))) < <7(1(1 + |a|) (|y - x\ 2 + | T(y) - T(x )| 2 ) . 

Since ((,a) € N^ pi ^(x,T(x)), by Theorem 13.61 we have that ( £ ^ r n(T( x j )( x ') an( ^ bi(x,Cf) = a. 
Hence if ( = 0 then a = 0. Thus (15.11) holds. Now assume that ( ^ 0. We have two possible cases: 

(i) T(y) > T(x), 

(ii) T(y) < T(x). 

We now deal with the case (i). Let y(-) be an optimal trajectory starting from y. Set r : = 
T(y) — T(x) and y± := y(r). Observe that y\ € lZ(T(x)). By Gronwall’s Lemma, there exists a 
constant K\ := K\(5) such that | y — y(t)\ < K\t for all t G [0, T(y)\. We have 

(5-2) (C, y-x) = (C, yi-x) + (c, y ~ ®i) =: (I) + (II). 

Since y\ G 1Z(T(x)) and lZ(T(x)) is ^o-convex, one has 

(I) < To\C,\\yi ~ x < p 0 \C,\(\y - x\ + \y - yi\f 

< ^olCldy-^l + ^R) 2 

(5.3) < R 2 |C|(|y-x| 2 + |T(y)-r(x)| 2 ) 

for some suitable constant := K2(5,po). 

Now let z(-) be the measure function which is the projection of y on F(x) restricted to [0, T(y)\, 
i.e., 

z(t) = proj F ( x )y(t), for a.e. t G [0 ,T(y)\. 

By the properties of F, there exists a constant L := L(5 ) such that 

| y(t) ~ z(t )| < L\y(t) - x\ < L(\y(t) - y\ + \y - x\) < LK^r + L\y — x\, a.e. t G [0,r], 
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Let us consider (II). We have 

(II) = - [ ((,z(s))ds+ [ (C ,z(s)-ij(s))ds 
Jo Jo 

-h(x,C)r + |C| [ (LKir + L\y - x\)ds) 
Jo 


< -1 


(5.4) 


< -h(x, C)(T(y) - T(x)) + K 3 \C\ (|y - x \ 2 + \T(y) - T(x )| 2 ) 


for some suitable constant K 3 := K 3 (5). 

From (J5.2I) - (15.41) we obtain (15.11) for the case (i). 

We now consider the case (ii). Let x(-) be an optimal trajectory starting from x. By Gronwall’s 
Lemma, we may assume that \x(t ) — x\ < K\t for all t £ [0,T(x)j. Let p(-) be an arc such that 
(x,p) solves the system 


x(s) = V p H(x(s),p(s)), 
-p(s) € d x H(x(s),p(s), 


in [0,T(x)] with x(0) = x and p( 0 ) = 

Since ( £ ^tz(t( x ))( x )- by Theorem 14.61 we have — p(t) £ N-ji(-r(x(t )))(^'(^)) f° r a b t £ [0,T(x)j. 
Set r\ := T(x) — T(y) and x\ := x(r\). We have 


(C,y~x) = (p(n)-p( 0 ),y-x) + (-p(r 1 ),y-xi) + (-p(r 1 ),xi-x) 

(5.6) = : (III) + (IV) + (V). 

We first consider (III). We have 

(III) = I (p(s),y - x)ds < I < 4 f \p(0)\\y - x\ds = K 4 \(\\y - x\n 
Jo Jo 

(5.7) < Iu ICI (I y - x \ 2 + | T(y) - T(x )\ 2 ), 

for some suitable constant K 4 = K^S). 

Since —p(r\) £ N^^^ x ^(x\) and 1Z{T(x\)) is <po -convex, there has 

(IV) < ip 0 \p(ri)\\y - xi \ 2 < ip 0 \p(ri)\(\y - x\ + \x - Xi \) 2 

(5.8) < K 5 \(\{\y-x \ 2 + \T(y)-T(x)\ 2 ), 

for some suitable constant K$ = K 3 (5,po). 

We now consider (V). We have 

(5.9) (V) = f (p(s) -p(n),x(s))ds+ [ (-p(s),x(s))ds. 

Jo Jo 

By the sublinear property of F and the fact that 71(5) is compact, there is some constant Kj = Kf(5) 
such that |x(s)| < K 7 for all s £ [0, T(x)\. Using Lemma 14.21 we have for all s £ [0,ri], 

(p(s) -p(ri),x(s)) < | p(s) — p(ri)||x(s)| < K s \n - s||p(ri)| < K 9 \(\n, 


for some suitable constants Kg = K 3 (5),Kg = Kg(5). Therefore, we have 

(5.10) [ (p(s)-p(r 1 ),x(s))ds<K 9 \C\rf = K 9 \C\\T(y)-T(x)\ 2 . 

Jo 

To estimate the second term in the right-hand side of (15.91) . we first note that, for all s £ [0,T(x)], 
(~p(s),x(s)) = -H(x(s),p(s)) = h(x(s),-p(s)) = h(x(0),-p(0)) = h(x, (). 
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Hence 

(5.11) [ (-p(s),x(s))ds = h(x,()(T(x)-T(y)). 

Jo 

From (15.61) - (15.111) . we obtain (15.11) for the case (ii). 

We now progress as Step 2 in the proof of Theorem 3.7 in m and conclude that there exists a 
continuous function tp such that the epigraph of T\s(s) is <£-convex. The proof is complete. □ 

We now give some examples in which assumption (R(5,p o)) holds true for some 5 > 0 and 

Po > 0. 

Example 5.2. (a) Let F(x) = {Ax + u : u G U} for all x G M ra ; where A G M nxn (M) and U is 
a nonempty compact convex subset ofW 1 . Let the target K be a closed, convex subset ofW 1 with 
h(x, C) < 0 for all x G /C and ( G N£(x). Then IZ(t) is convex for any t > 0 (see Proposition 3.1 
in M)- In this case, assumption (R(5, po)) holds for any 5 > 0 and po = 0. Therefore, one can 
apply Proposition 15.11 to obtain the results in [IB]. 

(b) Let /C = {0} and F(x) = {f(x) + g(x)u : u G [—1, l] m } for all x G K 2 , where f : M 2 —» M. 2 ,g : 
M 2 —> M 2 xm(®)) m = 1 or m = 2, are of class C 1,1 (with Lipschitz constant L) and 

(i) /(0) = 0, 

(ii) rank[c/j(0), Df (0)gi (0)] = 2, for i = l,M where g = ( gi,g m ), 

(iii) Dg{ 0) = 0. 

Then there exists r > 0 depending only on L, f(0),g(0) such that IZ{t) is (strictly) convex for all 
0 < t < t (see Theorem 5.1 in [H]j. Therefore (R(d,ipo)) holds true for 5 = r and po = 0. 

We are now going to give conditions to ensure (R(5, <po)) for differential inclusion which may not 
admit parameterizations with smooth functions using a result given by Plis [25]. We first give some 
discussions on the assumptions were given in [ 25] . 

Definition 5.3. For a given real number a > 0, a subset S of Ml 1 is called a-regular if for all points 
xo,xi G S and number A G (0,1), the closed ball 

{x G M n : \x — Axi — (1 — A)xo| < aA(l — A)|xi — xo| 2 } 

is contained in S. 

Note that if S is an a-regular set for some a > 0 then so is —S. Moreover, any a-regular set is 
convex. A singleton is an a- regular set for any a > 0. 

Let Si,S 2 C M n be compact. The Hausdorff distance between 5i and S 2 is defined as 

dist H (Si, S 2 ) ■■= max{dist^(S , i,S'2),dist^(5 2 ,S'i)} , 

where dist^(S f , S') := inf{e : S C S' + eB}. 

The following class of multifunctions was introduced in [ 25] . 

Definition 5.4. A multifunction F : M n M n is said to be of class C if there exists a positive 
constant C such that for any points x, y G M n and for any number A G [0,1], we have 

(5.12) dist-H(F(Ax + (1 - X)y),XF(x) + (1 - A )F(y)) < CX{\ - A)|x - y\ 2 . 

Observe that if F : R n M n is of class L then so is —F. Moreover, the condition (15.121) is 
equivalent to the fact that the function x 1 —>• H(x,p ) is both semiconcave and semiconvex for all 
p G M n , that is, 
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(H3) x i-» H(x,p ) is of class C 1,1 for all p E K n . 

Note that this fact is also mentioned in m- 

Let A be a compact convex set and p be a non-vanishing vector. Denote by w(p, A) such a point 
of A that 

(w(p,A),p) = ma x weA (w,p). 

For given compact, convex sets A, B , we define 

s(A,B) := max W7 L 0 \w(p,A) - w(p,B)\. 

In [25] . the following assumption was made on the multifunction F, for 1 , 1/6 M n 
(5.13) s(F(x),F(y)) < k\x - y\, 


for some constant k > 0 . 

The assumption (H2) implies that the argmax set of v *->■ (v,p) over v E F(x), x,p E M n ,p ^ 0, is 
singleton which equals S7 p H(x,p). Thus, for x,p G M n ,p / 0, 

w(p,F(x )) = V p H(x,p). 


We have for r,pG M n , 


s(F(x),F(y)) = maxp^oIVpiL(z,.p) - V p H(y,p)\. 

Then again by (H2), (15.131) holds locally. Therefore, (15.131) can be seen as a consequence of (H2). 
For our result, we need the following technical lemma. 


Lemma 5.5. Let A,Bc. K n be such that A C B and bdryL> C A. If A is convex then so is B. 

Proof. Assume to the contrary that B is not convex. Then there exist x,y G B such that \x, y]\B ^ 
0. There also exist x±,y\ G [x,y] D bdryL> such that [xi,yi] \ B ^ 0. Since bdryL? C A and A is 
convex, we have [x\,yi] C A. Hence [xi,yi] C B due to A C B. This contradiction implies that B 
is convex. □ 


Proposition 5.6. Assume (F), (H) and (H3). Suppose that /C is compact and that, for some 
a > 0, /C and F{x) are a-regular for all x G M n . Then there exists t > 0 such that TZ(t) is convex 
for all t G [0, t\. 

Proof. For T > 0, let A()C, T ) be the attainable set from K. at the time T for the reversed differential 
inclusion 

f y(t) G —F(y(t)), a.e. t > 0 
1 ’ \ i/(0) = x G M n 

that is, 

«4(/C, T) := {y(T) : y(-) solves ([5. 141) with x G 1C}. 

It is easy to see that 

(i) A(JC, T) c F(T), 

(ii) bdry 1l(T) C A{K,T). 

As shown in [25] (see also Corollary 3.12 in 0 ), there exists a number r > 0 such that A(IC, t ) is 
convex for all t G [0, t]. From Lemma 15.51 F(t) is convex for all t G [0, t]. This ends the proof. □ 


The main result of this section is stated as follows. 
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Theorem 5.7. Under the hypotheses of Proposition [XT] and \ 5. 61 there exist a number r > 0 and 
a continuous function ip such that the epigraph of 7js( r ) is p-convex. 

Proof. It follows from Proposition 15.11 and 15.61 □ 


Corollary 5.8. Under the same hypotheses of Theorem 5. 
all the properties listed in Proposition \2.S\. 


the minimum time function T satisfies 
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